Rajnath Singh led the delegation of 26 MPs from 20 parties which stayed overnight in Srinagar before stopping over in Jammu this afternoon.
He is suspected to be suffering from cancer in the kidney.
"We will take part in the talks, which are meant for resolution of the issue," the firebrand leader said.
Jammu and Kashmir chief minister, Omar Abdullah on Thursday asked the leaders of the moderate All Parties Hurriyat Conference group to hold talks with the government of India as well, after their return from Pakistan.
Both sides will discuss the ongoing incidents of ceasefire violations at the border, the resolution of which will be given topmost priority
While they were invited with protests at Geelani's home, they were turned away by Yasin Malik, who was lodged in jail.
All Parties Hurriyat Conference Chairman Mirwaiz Umar Farooq has accused the Jammu and Kashmir government of outsourcing the handling of the state to security agencies and is treating it as law and order situation than a political one.
Questioning Jammu Kashmir Liberation Front chairman Yasin Malik's recent decision to share the stage with Hafiz Saeed, the mastermind of the 26/11 Mumbai terror attacks, in Islamabad, Rashtriya Swayamsevak Sangh leader Ram Madhav on Tuesday said the Centre should take due note of this act and take very strong measures to send a message to him and persons of his ilk.
Hardline Hurriyat Conference leader Syed Ali Shah Geelani on Thursday threatened to launch an agitation after Eid against the plans to construct a road to Amarnath shrine in south Kashmir.
"Several innocent people have been killed and I strongly feel violence should come to an end," Abdullah said.
Altogether 45 participants from India and Pakistan, including retired generals, former bureaucrats, journalists and politicians are participating in the three-day meet on Kashmir.
The dialogue with Malik will be the prime minister's second meeting with a separatist group outside the Hurriyat Conference fold.
'As far as I know Burhan Wani did not kill anyone.'
The 45-year-old separatist leader has been booked under the harsh law for waving Pakistani flag and chanting anti-India slogans at a rally in Sringar.
Stone-pelting broke out in Baramulla town of north Kashmir soon after hardline Hurriyat Conference leader Syed Ali Shah Geelani on Friday addressed a gathering there, police said.
The Centre does not want to keep the military in Kashmir 'for long' but a decision on removing the controversial Armed Forces Special Powers Act will be taken only after some time, says Home Minister Sushilkumar Shinde.
Expressing serious reservations regarding the court martial of army personnel involved in Machil fake encounter, the moderate, All Parties Hurriyat Conference chairman Mirwaiz Moulvi Umar Farooq on Friday said, "Machil and all such cases should be heard in civil courts under wide public gaze instead in the closed rooms."
'The Modi government has turned the basic fundamentals of its Pakistan policy on its head.' 'It means an admission that its hands-off-Hurriyat policy was flawed and it is ready to engage with Pakistan without minding if the Kashmiri separatists talked to the Pakistani government,' says Rajeev Sharma.
An aerial survey of the Baltal-Amarnath holy cave route does not reveal any road widening or construction work being undertaken by the Jammu and Kashmir government in the ecologically fragile Himalayan region as alleged by hardline Hurriyat Conference.
Normal life was affected in Kashmir Valley on Sunday following a strike called by hardline Hurriyat Conference to protest the killing of a three-year-old boy by unidentified gunmen in Sopore.
Former Hurriyat chairman Mirwaiz Umer Farooq, who along with another moderate leader Abdul Gani Bhat, attended the two-hour meeting, said such interactions should increase and similar meetings should be held in Muzaffarabad, Srinagar and Jammu.
Police feared a clash between their supporters in Srinagar.
Rubbishing the interlocutors' report on Kashmir, hardline Hurriyat Conference leader Syed Ali Shah Geelani on Friday said their boycott by separatists has been vindicated as the document is like a "dead mouse" found after digging a mountain.
Vohra said he would first meet important people in the legislature and based on those interactions, drwa up a programme for future talks.
Separatist leader Masarat Alam Bhat on Thursday denied waving Pakistani flag at a rally organised to welcome his senior Syed Ali Shah Geelani in Srinagar, but said it was a representation of the feelings, aspirations and sentiments of the people across Kashmir.
"We condemn the brutal use of force by Indian security forces against peaceful and unarmed protesters," it said.
Mirwaiz also alleged that 'human rights violations by security forces' are continuing in Jammu and Kashmir and there is an urgent need to put an end to them.
Intense clashes had rocked Kashmir Valley in 2016 following the death of Hizbul Mujahideen commander Burhan Wani in July that year, resulting in the death of over 85 people.
Charges were framed on Saturday against a close aide of hardline Hurriyat leader Syed Ali Shah Geelani and three others, arrested for allegedly running hawala racket to fund banned terrorist outfit Hizbul Mujahideen in Kashmir Valley, by a Delhi court, paving the way for their trial.
India on Friday made it clear to Pakistan that it should not go ahead with the meeting of its NSA Sartaz Aziz with Hurriyat representatives in New Delhi when he comes to hold talks with his Indian counterpart Ajit Doval, saying it will not be "appropriate".
Among the first four militants who launched the violent secessionist movement in Kashmir in 1989, separatist leader Yaseen Malik on Thursday left on his first visit to the Pakistan-occupied-Kashmir in 17 years.
A shutdown called by hardline separatist Hurriyat Conference to protest against the Jammu and Kashmir government's decision to shift prison inmates from the Valley to outside jails affected normal life in Srinagar on Tuesday.
Indian Army has taken the initiative to induct women in rank and file, and the first batch of 100 women soldiers is undergoing training at Corps of Military Police Centre and School, he said.
Hard-line Hurriyat Conference chairman Syed Ali Shah Geelani on Monday rejected the Truth and Reconciliation Commission proposed by Chief Minister Omar Abdullah and demanded a United Nations-appointed factfinding mission to probe the unmarked graves in Jammu and Kashmir. "We vehemently reject the Truth and Reconciliation Commission as we do not expect justice from the system which is perpetuating human rights violations in the state," Geelani said.
Delegations of Kashmiri Pandit organisations on Friday met Union Minister Jitendra Singh seeking the Centre's intervention in allowing a pilgrimage to Kounsarnag Lak in South Kashmir, a day after locals had protested against the event.